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ARSTRACT 



Schools (DoDDS) 
Readiness Tests 



As part of the Department of Defense Dependents 
annual assessment 'of achievement,, the Metropolitan 
(MRT) were administered to .approximately 14,768 
first-grade pupils in the- fall of 19d3. The mean scaled scores of the 
DoDDIs first graders clustered Ground the national mean 'of 150. The 
OoDOS mean scares in the Various skill ateas ranged from a high -of 
7.5 points above the net iott,al- mean in auditory skills to a low of 1.1 
points below the national flieai]^ in language. The:DoODS basic skills- 
achievement testing program was adainistered to 47,861 students in 
all five DoDDr\r eg ions'. Known as tbe Systestwide Testing Program, .it 
measured the perf«r^Bance of students enrolled in grades 4, 6, 7, 9, 
and 11 in the basic skill areas of reading, language ^ts, and 
mathematics.. DoDDS ^students oq the average 'performed bitter than . 
tfaelr tftfttesi^e^-<;ounterparts. Overall per^rmance. on the tests 
Indicated .hlg|h acliickvement f or grades 6, 7, 9, and 11, with grade 7 
evidetici-ng The highest perfdJisaice. in' the v^ontent areas, language 
erts^was <;bse'tved as the strongest area, followed by reading and 
mftttltlBatics, respectively. By contrast « a notable weaknjess Vas 
evid«»nced in grade 4 ^thematiVi^.MJ)l9) , 
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INTRODUCTION 

The annual assessmenuof a<±jevement of the Department of Defense Dependents Schools 
(DoDDS) students in selected elementary and secondary school grades was conducted in accordance 
with Section 4405 (a) and (b). Title AIV, Defense Dependents' Education Act of 1978, PL 95-561, 
and DS Regulation 2000.6. 

Policy 

\. Annual assessment of achievement in the subject areas of reading, language arts, and . 
mathematics shall be administer^l to all pupiis enrolled ki specified primary, elementary, and 
secondary grades. 

Bt An anr^ual school readiness assesshient shall be administered to all pupils entering first grade. 

C. The individual pupil results of the assessmeii^ shall be report^ to the pupils, tfieir parents, 

« and their classroom teachers. These re$u\s shall become part of the' pupil's academic recoi«d. 

D. Within 90 days of completion of the assessments, /ummary r^ults of group performance for 
each of the annual assessments shall be made available to the professional ^ucators of the 
dependents' schools system and to Members of Congress. 

DoDDS grade 1 students were administered the Metropolitan Readiness Tests (MRT), published by 
the Psychological Corporation, Students enrolled in grades 4, 6, 7, 9, and 11 were administered the 
Systemwide Testing Program (STP), which consists of Reading, language Mts, and mathematics 
basic skill measures developed for DoDDS by CTB/McGraw-Hill Publishing Company. 

The assessment administration occurred during the fall of 1983. Students in grade 1 were tested 

with the MRT the first 2 weeks of school, while students in grades 4, 6, 7, 9, and U were admin- 

jstered the STP near the end of September. The 1983-84 assessment involved approximately 63 ♦(XX) 

dependents schools* students spread across the five DoDDS regions. 

« 

provided for each student, classroom, school, 

^ , - ^ ^ 

This document reports the results to tlie Congress, school personnel, parents, ai^ other interested 
citizens. The'results are presented in two parts: Part I - First Grade School Readiness Testing ' 
Program and Part 11 - Systemwide Testing Program. ^ . ' 



SUMMARY OF FINDINGS 

• • \ 

Me{ro|olitan Readiness Tests 

The Metropolitan Readiness Tests (MRT) were administered to approximately 14,768 first-grade 
pupiU in the fall of 1983. The MRT is designed to provide a skiH-based assessment of those 
enabling skills that are impoijant for early school learning in reading, mathematics, and language 
developmertt. ' . * ^.^ 

The mean scaled scores of the Department of Defense Dependents Schools (DoDDS) first graders, 
as a group, cluster around the national mean of 150. The DoDDS mean scores in the various skill 
areas ranged from a high of 7.5 points above the national' mean in auditory skills to* a low of 1.1^ 
points below the national mean in language. It was found that students who were reported to be 

proficient in English- scored substantially higl>er than students who were n^t proficient in English. 

^ 

Systemwide Testing Program 

The DoDDS basic ^kills achievement testing program was administered during the, last 2 weeks of 
September 1983 to 47,861 students in all five DoDDS regions. Known as the Systemwide Testing 
Program, it measured the performance of students enrolled i^i grades 4, 6, 7, 9, and 11 in the ba&ic 
skill areas of reading, language arts, and mathematics. 

DoDDS students on the average perform better than their stateside coiinterparts. Overall perform- 
ance on the tests indicates high achievement for grades 6, 7, 9, and 11, with grade 7 evidencing the 
highest performance. In the content are^, language arts is observed as the strongest area, followed 
by reading and mathematics, respectiveiy. By contrast, a notable weakness is evidenced in grade 4 
mathematics. Performance in both ipultiplication and divi^on computation substantially lowered 
the fourth-grade scores. • 

» 

t 




PARTi 



FIRST QRADE READINESS TESIVNG PROGRAM 

INTRODUCTION 

During the week of Set)tembcr 12-16 of school yeai' 1983-84, all entering first-grade pupils in the 
Department of Defense Dependents Schools (DoDDS) were administered the Metropolitan* 
Readiness Tests (MRT), Level II-, Form P. This teport describes the testing procedures and presents 
a summary of the results. 



DESCRIPTION OF THE TESTS , 

The MRT, published by the Psychological Corporation, is a widely-used standardized>Sttery of 
tests designed to measufe the school r^diness skills associated with beginning reading and 
mathematics instruction. The 1976 edition of the MRT was normed in a nation-wide standardiza- 
tion project involving over 100,000 students in 322 school districts representing a cross-sectiqn of 
schools in the United States. The standardization process offers the capability of comparing , 
DoDDS scores with the scores obtained by a representative national sample of students. j 

Four broad skill areas are measured, each of which contains two subtests as specified t^low: 



SKILL AREA 



Auditory 
Visual 
Language 
Quantitative 



SUBTESTS 



Beginning Consonants 
Sound-Letter Correspondence 

Visual Matching • 
Finding Patterns 

School Language 
Listening 

Quantitative Concepts 
Quantitative Operations 



J 



Scores are generated for each of the skill areas. In addition, the auditory, visual, and language 
subtests are combined to produce a prereading composite score. 



METHODOLOGY 



A total of 14,768 entering first-grade pupils were administered the MRT battery. Table I 
summarizes the DoDDS regional participation in the assessment project. / 

Classroom teachers administered the test battery using the standardized test administration pro- 
cedures outlined in the teachers' manual. Fall norms forWge city. school systems were used to 
generate descriptive data, including group means, standard deviations, percentile rank scores, and 
stanines. Standardized scaled scores were produced to compare perfornjance across skill areas. 
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, Table 1 • 

Total Number of Students Administered the MRT by DoDDS Region 



• 

Atlantic 


Germany 


Mediterranean 


Pacific 


f 

Panama 


QoDDS 

Total 


4 




^ 






^ 




8885 


1235 


2676 


661 


14,768 



RESULTS 

•In Table 1 are the |pan. percentile rank scores and the mean- scaled scores for each of the skill area 
composites for DoDDS. Table 3 presents the regional scores.^fhe mean scaled scores allow for 
comparisons across skill areas. TJjese data suggest a someyvhat even performance across the skill . 
ai:eas, with a scaled score ran^e from a low of 148.9 (language) to a high of 157.2 (auditory). Per- 
formance was strongest in the auditory skill are^, which assesses perceptual recognition of begin- 
ning letter consonarrts and sound^to-letter correspondence. Performance was lowest on the 
language skill subtests, which test forlistening comprehension, use of grammatical structures, and 
comprehension of school-related language concepts. 

Seveifty-four percent of the studenfc&ywere Ji^ported to have at least average proficiency in English. 
(See Table 4.) Those ^students averaged 155.7 scaled score points in the quantitative area and 157.9 
in the prereadihg area. Students below average in English proficiency scored 23.8 points lower in 
the quantitative area (131.9) an4 2l7 points lower in the prereading area (134.2). A substantial 
discrepancy in sctares exists also between pupils who attended kindergarten and pupils who did not 
Attend kindergarten, (See Table 5.) However, caution must be taken when interpreting the data, 
due to the large percentage of pupils ror whofirt there Were lio responses to these questions. 



Table 2 
DoODS Scores by Sklii Areb 



. 1 




Percentile Rank of 








Skill Area 


Mtean Raw Score 

« 


^ean Scaled Score 




Auditory Composite 


65 




(^6.6) 




Visual CJomposlte 


50 


152J8 


(^8.5) 




Language Composite 


36 


148.^ 


(29.6) 




Quantitative Composite 


' 40 




(26.4) 




Prereading Composite 


60 


^ 4A2.5 \ 

— -U 


(25.1) 




150 = National Mean Scaled Score 


( ) Standal 


jd Deviation 
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/ 
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Table 3 • 

f 

Regional Mean Scores Skill Area 



Skill Area 



4 



Atlantic 



X = Mean Scaled Score 
PR = Percentile Rank 



^iedi- 

Germany terranean 



Audltorv 


X 


158.5 


- 155.8 




SD 


26.0 


25.6 




PR 


»65 , . 


60 


Visual 


"x 


152.1 


151.6 


it 


SD 


28.4 


29.0 




PR 


46 


45 


« 

Language 


X 


154.7 


149.7 




SD 


29.8 


29.1 




PR 


50 


35 


Quantitative ' 


X 


153.8 


149.2 




SD 


26.7 


2QA 




PR 


50 


, 40 


Prereading 


X 


154.2 


151.5 




SD 


25.2 


25.7 




PR 


60 


55 



Pacific 



Panama 



153.6 
26.6 . 
55 


16f.4 
23.9 
75 




162.8 
25.7 
75 


149.9 

27.2, . 
40 


158.2 
^ 27.4 
65 




154.3 
27.5 
50 


146 3 
29.4 
30 


145.1 
30.2 
25 




146.1" 
31.1 
25 - 


146.1 
25.9 
30 


154.7 
25.7 
55 




148.1 
27.6 
35 


149.0 
24.5 
50^ 


155.7 
23.0 
\ -65 




154.9 
24.4 
65 



SD = Standard Deviation 
150 = National MeaiVScaled Score 



Table 4 

Quantitative and Proreading Composite Scaled Scores ^ 
By Response to Language-Related Demographic Questions 



' Qu^stioniRdsponse 



Quantitative 
M6an Scaled 
Score 



Prereading 
Mean Scaled 
Score 



Percent 
Responding 



How proficient is the child in English? 

Below Average 
' Average 

Above Average 

High 

No Response 

Does the child experience a home 
language other than English? 

Yes 

No 

No Response 



131^ 
149,2 
160.6 
157.3 
1^7.0 



/ 



134.2 
151.1 
163.1 
159.6 
149.1 



146.7 
151.8 
147.8 



149.0 \^ 
154.0 
150.2 > 



7 
45 
12 
17 . 
19 



19 
66 
15 



^ Tables 

Quantitative and Prereading Mean Scaled Scores 
By Response to KInctorgarten Attendance Questions 





< 

*> 

Response 


Quantitative 
Mean Scaled 
Scorer 


Prereading . 
Mean Scaled 
Score 


1 Percent 
Responding 




Attended Overseas In DoDDS School 


150.1 


152.4 


64 




Attended Overseas In Non-DoDDS SchobI 


151.3 V 


•152.2 


• 2 




^Attended Stateside 


154.7 


156.« 




Did Not Attend . 
No Information 


137.5 
149.0 


139.2 
{ 14^.3 






No Response 
"'" 1 ' — ' — — 


148.6 
^ 


^ 151.0 ^ 
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The niean^4caied scores of DoDDS first graders as a group cluster around the national mean scaled 
score of 150. This is substantiated by the regional data in Table 3 and the observed percent of 
scores within each stanine in Table 6. Table 6 iOustrjates the clustering of performance within the 
middle three stenines (4-6), which exceeds the expected stanine distributio'n from the test standard- 
ization. Fewer pupils than expected are scoring in ih^ lower and upper stanine ranges on the 
prereading arid ^quantitative composites. )r 

Substantial scorejncreases frdm school year 1982-83 to school year 1983-84 arc evident in all skill 
areas. (See Figure 1.) Increases of 10 pfrcentage points are found in the auditory, visual, language, 
and prereading areas, whereas the quantitative increase was 5 percentage points. 



Observed and Expected Percent 



Table 6 . 
of l>oDDS Pupils Scoring Wittiii) Each Stanine 



2CX 







Observe!! Percent of Scores Within Each Stanine 


stanine 


Percent 


Auditory 

♦ 


Visual 


Language 


Prereading Quantitative 


9 


4.0 


5.4 




- 5.8 


3.1 


1.8 . 


8 


7.0 


9.8 , 


5.3 


6.9 


4.0 


- ' .3.0 


7 




10.0 


14.8 


9.4 


ii.a 


10.5 


6 


17.0 


23!e 


15.1 


11.1 


19.9 


15.4 


5 


*20.0 


23.6 


24.2 


23.7 - 


27.5 


24.4 


4 


'17.0 


15.0 


18.0 


20^5 


19.2 


26.8 


~*3 

1 

2 
1 


12.0 
7.0 — 
4.0 


p.5 

2.7 - 
1.4 ' 


10:9 

* 

6.3 
2.4 


12.9 
6.9 

2.8 


9.3 
3.6 
1.6 


12.1 

2.-1 


High 


23 . 


25.2 


23.1 


22.1 


19.0 


15^3 ' 


Average 


54 • 


. 62.2 


57.3 


65.3 


66.5 


66.6 


Low 


23 ■ 
1^ 


12.6 


19.6 


22.6 


.14.5 


18.1 



/ 



o 
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Figore 1 , ^ * 

DoDOS Percentile Rank Scores by Ski\) Area: 
* ' SY 1982-83 Versus SY 1983^ 
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INTRODUCTION ' . 

*. , • v. . " ■ ' 

The T)dDDS Systemwide'Tcsting Program (STP) measures the status of basic skills achievement. 
Students in grades 4, 6, 7; 9, and 1 1 wefe administered, the STP rtading, language arts, and 
mathematics tests during the week of September 2d, 1983. ' 

DESCWPTION OF THE TESTS ' v ' * 

^ . t > .■ 

. The STP-tests are standardized measures of basic skills achievement for reading, language arts, and 
mathematics developed by CTB/McGraw Hill PubUshing Company forking in conjunction with' 
DoDDS evaluatitm and curriculum personnel. CTB/McOraw-Hill designed the test instruments to 

/ collect student performance data indicating learned attainment relative t^^DDS educational 
objectives arid to reflect any difference in performance occurring across^^^ levels. The 25 
objectives included in the t^ts represent the wide array of skills taught inWSFd knowledge, reading 

' comprehension, janfeuage, usage, and mathematics application, and* represent information students 
are expected to know at the tested grade levels. , 1 , ' 

- jhe Reading Test assessed student performance in three domains: word attack, vocabulary, and 
g^cading comprehension. Wotd attack was assessed at the fourth gmde level only. Vocabulary and 
idtng comprehension were assessed ^oss the/ive griidc levels. 

"Likewise, student performance in language acts was assessed in three domains: spcH^ng^ i2iguage 
mechimics, and language expression. ' 

the mathematics test assessed student performance in two domains: math computation and ^ 
mathematical concepts and applications. ^ ^ 

Locational skills, which might be considered a part of either the reading or language arts curricula, 
was treated as a separate dopiain and tested at four grade levels: 6, 7, 9, and 1 1 . 

The number of items in these domains ranged from 4 to 23. ' * i- 



Table 7 presents the content coverage of the tests for each grade. A description of the tests' 
category objectives is included as Appendix A. and the test development procedures are included as 
Appendix B. 
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Table 7 . 
STP' Contant Coverage. 



Subtests 



Skill Areas 



Word Ati^ok • 

1% , Letter-Sound Correspondence 

Structural^ Analysis 
Phonic Anafysis . 

Vocabulary r . 

Word Meaning 

fteadlnfl ComprehfenslOn 

Lfferal Cpmprehenslon 
Literary Works i . * 
Higher-Level Comprehension 



6 



Number of Items at . 

Each Grade JLevel 
^ y 

' Z '9 11 



6 

9 . 
5 ^ 

23 23, 



23 



12 
7 
4 



9 
8 
6 



Oi 



23 • 23 



6 
6 
12 



5 
9 
9 



Spelling 
















Spelling 




on 








'Language Mechanics 
















Capitalization 


10 


6 




1 






Punctuation 


6 


9 


11 


10 


10 


t 


Editing Skills 


4 


6 


9 


i6i 


10 


Language Expression 


I 












• 


(Jsage 


9 


8 


5 


4 


5 




Sentenq^ Development 




6 




7 


4' 




Paragraph Development 


6 


9 


11 


12' 


* 13 


Math Computation 


» 














Addition 




5 


.5 


5 


5 


« ■ • 


Subtraction 


5 


5 


5 


5 


5. 




Multiplication 


5 


5 


5 


5 


5 




Division 


5 


5 


5 


5 


5 


Math Concepts and Ap^iloatlons 














Number Awareness 


8 


9 


« 


. 6 


7 




Problem Solving 


8 


9 


9 


12 


11 




Measurement/Geometry 


4 


4 


4 


4 


4 


Locational Skills 
















Book Parts ^ 




12 


4 


9 


9 




Dictionary Skills 




4 


4 


5 






Library Skills 




4 


8 


6 


11 




Consumer Sk|ls - 






4 







METHOm>LOGY " I 

** . * • 

The DoDDS regionil^ evaluation coordinators, building cdordinators, and examiners were responsi- 
ble to .the regional directors for the proper 'administration and security of DoDDS" STP materials. 

In preparation for the test administration, the regional evaluation coordinators werd provided in- 
seryfifx training to assist thehijn conducting workshops with building coordinators. 

After attending buildii^; coordinators' training scions, the^ building coordinator scheduled and 
conducted training for the classroonr examiners, Jhe buil<j^ng coordiqatoff used the Building <Coor- 

. dmator's Manual and Examiner's Manual with other appropriate materials to comkct the training 
session. f r 

. . ■ .'■'.<. « 

Tests were administered the last week of September 1983. A total of 47,861 students across the five 
DoDDS ilgions participated in the assessment. The Germany Region had the largest percentage of 
students participating in th^pr^am, followed by the Pacific, the Atlantic, the Mediterranean, 

. ahd Panama rti^^ions. Table 8 jUsplays the number SntJ^ percentage of i^artidpating students by 
grade and region. ' . 

Practidc tests were available and administered in gAdes 4 and^. At the completion of testing, each 
individikl school within th»>Yegions a^senbled and packaged answer sheeU and shipped them td 
the contractor, CTB/McGfaw-Hill Scoring Center, Durham, North Carolinji. TMe answer sheets « 
were scored, reports were generatcd,.and the results returned to.the DoD schools. 



Tables 

Number and Parcanf of Students in Each Grade Level and Degton 

Participating In DoDDS STP , 

FaH1983 



Grade 


Atlantic 


Germany 


Med. 


^'clfic 


Panama 


Total 


% Grade 


4 


1318 


7057 


J172 


2180 


553 


12,280 


25.6 


6* 


1248 


6206 


1177 


2013 


546 


11,190, 


^.4 


7 


1242 


5966 


1109 


1888 


495 


10,700 


22.4 


9 


1002 


4506 


864 


1375 


492 


8,239 

r 


^ 17.2 


, 11 


725 


2930 


531 


899 


367 


5,452 


11.4 


Total ti 


5,535 


26,665 


4,853 


^ 8,355 


2,453 


47,861 




ReglonaL 












• 




Percent- 




< 




J 








age' 


11.6 


56.7 


10.1 




5.1 




100.0 
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STP provides two 'types of scores to help assess the instructional needs of students: nor*n- 
referenced and criterion-referenced scores. The norm-referenced .score information an.swer^ the 
question, "How do DoDDS students compare with the national norm?" The criterion-rVferenced 
information answers the question, "How well are DoDDS students mastering the curriculum objec- 
tives?** In providing answers to these questiolis, the test results are reported in ajvaricty of formats 
designed to best meet the needs of the user.. For example, the clas'sroom reports are organized in a 
way <hat allows- the teacher to focus on ancl utilize relevant information about individualltudents 
and the class as a whole. The data are -reportjd on other group reports (school, region, and system*^ 
wide) in such a way t^at contrast can pe ma(|t between the extent to which different educational 
objectives are being attained and what most needs to be accomplished. ^ ^ 



RI':SIJLTS 



The scale score is the basic^ score for DoDDS STP. It is used primarily to provide a basis for deriv- 
ing the percentile scores which are u.sed to describ^test perfdrmance. ' • <^ 

Table 9 and Figures 2,^3, and 4 f resent the mean scaled score comparisons between DoDDS 
students aniJ the national jiorming sample. ' ' 



Table 9 



Mean Scaled Score Comparison Be|^een DoDDS Studeiile'and 

National Norming Sample 



S.D. - Standard Deviation 

: : — -% 



Grades 




• 6 


7 


9 


11 


^ Total Reading 
DoDDS 

Natioaal Worm 

s.pi * , 


m 

♦ 652 
635 
^8.8 


716 * 
703 •' 
5l!8 ' . 


738 
7,16 
v43«4 


763 
748 
44.1 


787 
776 ^ 
39.4 


Total Language 
• DoDDS 
National Norm 
S.D. 

• 


65(f 
636 
42.2 


696 
684 
39.2 


716 
> 692 . 
44.2 


737 
' , 713 
48.9 


750 
732 
43.2 


Total Mathematics 
DoDDS 

National Norm 
S.D. 


646 
648 
39.7 


697 
692 
23.8 


714 
704 
24.1 


733 
723 
23.1 


742 
735 
23.3 



,0 



DbbDS Systemwide Tostiog Rrogram 
Comparison of Seized Scores 
1982 and 1983 



r 



TOTAL READING 



800 



750 



SCALt 

SCORES - ^00 



650 



600 




^^^^ DoDDS 1983 
DqDDS'1982 
NATIONAL NORM 



DoDDS 1983 
DoDDS 1982 
NATIONAL NORM 



4 


6 


7 


9 


11 


652 


716 


* 738 


763 


787 


648 


715 


737 


761 


786 


635 


703 


716^ 


748 


776 
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Figure 3 

DoDDS Systemwkto Te$tiiHi Progcam 
Comparison of Scaiod Sc<^ 
1982^ and 1S83 



r 



TOTVVL LANGUAGE 



\ 



^800 



^750 



SCALE 
SCORES 



700 



050 



600 




J 



DoDDS 1983 
DoDDS 1982 
NATIONAL NORM 





4 


6 


7 




9 


11 


DoDDS 1983 


650 


696 


716 




737 
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Figure 4 
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STP scores are f ypically reported by percentile rankings. Percentile rank scores range from 1 ^ 
through 99 .,A percentile rank may be interpreted as the percentage of students whese scores fall 
below a particular group's scale score. For example, if a group's mean scale sdore converts to a 
percentile rank of 71, this indicates that the group scored higher than approximately 71 percent of 
the liorming population. In Table 11 are the DoDDS mean percentile scores by grade. A review of 
the table *hows that at grades 6, 7, 9, and 11, DoDDS students' overall performance exceeds the 
national norm in all content areas. Students in gi^ade 4 attain a high level of performance in 
reading and language arts, but evidence weakness in mathjpiatics^ ^ 

llie mean percentile score^r Total Reading, Total Language Arts, and Total Mathematics are 
displayed in Table 10. Overall performance on the tests indicates high achieveihent for grades 6, 7, 
9, and 11, ' With grade 7 evidencing the highest performance. In the content areas, language arts is V 
observed as the strongest, followed by reading and mathematics, respectively. By contrast, a 
.notable weakness is evidenced by grade 4 mathematics as noted in Table 1 1 . ^ 

Performance in both multiplication and division computation substantially lowered the fourth, 
grade s^res. When^ores from 1982.and 1983 are compared, the data show increases in achieve- 
mem across the grades, with the most significant chan^ noted for grade 4. 

The regional performance and the sysfemwide results for SY 1^2-83 and SY* 1983-84 are presented 
in Table 12. These data ^llow for the comparison of student performance. Analysis of these data 
reveal that DoDD^ stu^nts continue to achieve at "higher levels of performance than their U.S. 
counterparts. , ^ 

Favorable increa^ in achievement is observed across the grades with strongest performance noted 
/or language arts followed by 'reading and mathematics, respectively. The data also show that. ; 
/ fourth graders still evidence low performance in mathematics, achieving scores which fall below the 
natidnal norm! However, when the data are examined fo^ significant improvements, the greatest ^ 
increase in achievernent is observed for grade 4 especially in the area of mathematics. 
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DoOOS Mean Percentile Scores* by Grade 
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Table 11 



Sutntest and Total Test Mean Percentile Scores by Grade 
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^ Table 12 ^ 

Mean Peitentiie Scores on OoDPS Systemwfde Testing Program by Qraci/amlFlegion 
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The following observaticms about ch^inges in achievement are also evideht from an examination of 
the data. 

Riding * * " ' 

• Reading test scores improved in four of th6 fivi grades tdtcd; namely, grades 4, 7, 9, and II. 

• Highest scores were achieved in the Atlantic Re^on; however, two grades show a loss. 

• The Panama Region shows significant reading score increase at grade 6. 

• The Panam^Re^ion, followed by Me^terranean, shows the 'most consistent increase in 
pcrformaiK^e. 

Language Arts 

• All re^ns show language arts score improvement at grade 11. ^ 

' f The^^pama Region shows tte high^ performance of the regions for the lower grad^, am} the , 
Atlantic Region scores are th^ higl^ at the u(^r gnicks. 

* 

• The Panama Region stK)ws dramatic imrreases at gracte levels 7 ami 9. 

• The Germany and the Pacific Regions show score increases in four of the five levels tested. 

• Language arts score improvement is noted across the regions for grades 7 and 11. 
Mathen*^ « ' . 

t * ' ■ 

• The most significant increase in mathematics achievement is observed at grade 4.. 

• Increaseid achievement was observed for each of the five grad^ t^ted in the Mediterranean 
Region. 

The Panama Region shows improvement in mathematics in four of the five levels tested with 
dramatic increas^^ occurring at grades 4, 7, and 9. 

• Three regions: Atlantic^ Pacific^ and Panama show a significant increaM in fourth grade 
mathematics. 



, DEMOGRAPHIC INFORMATION 

r 

Demographic information was compiled through im^^i^ual student da^ gathered at the time of 
the test administration. Table 13 reports the data/or ^BDSj^ystemwide. The information 
'included is self-explanatory; however, it may be important tJitote that nearly 50 percent of the . 
student population has been expos^ to the DoDDS program for /csy than 2 years. 

■I ^ 
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^ DoDOS System-wide Testing Program ^ 
0emogr«|^i6 Data 


• 


♦ 

n ■ 

: ~ 1 . : 


Number of 
Students 


Percent 


Grade 

Grade 4 *. 
Grade,6 

Grade 7 ' f. 
Grade 9 / 


12,280 
11,190 
' 10,700 
8,230 
5,452 


2^.7 
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5,536- ' 
26,665 
4,853 
8,355 
2,453 
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No > . 
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7.5 
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APPENDIX A 
Statements of DoODS STP Category Objectives 



Qr«d0 

4 



Word Attad( f 



Objdctive 1 



Obiective 2 



Qbjdctlve 3 



9 11 



Vocabulary 

Objective 4 



467. 
9 It 

467 
9 11 

467 
9 11 



4-6 T 

9 11 



46 



467 

9 11 

467 

9 11 



The 8tu<ient will Identify a word with the same long, 
short, r-controlled vowel sound as that In a given 
word; (tetter-Sound Correspondence) 

The student will recognize a a>mpound word and will 
identify the meanlr^ of a contraction. (Structural 
Analysis) 

The student will identify a word with the same vowel 
diphthong or digraph sound as that in a given word. ^ 
(Phonic Analysis) 



The 'student will identify synonyms and homonyms, use ' 
context clues, or Identify the mMnIng of a prefix or 
suffix. (Word Meanioi^ 



Reeling CempretMmfcm 



9b}ect}ve>« 
Objective 6 
Objective 7 

SpeMing 

Objective 8 



tfYe^tudent wHI ctomonstrate knowledge of the ele- 
ments of literal comprehension. (Literal Com^Kehensfon) 

The student will demonstrate knowledge of the 
.elements of literary works. (Literary Works) 

The student will demonstrate knowledge of the 
elements of higher-levef comprehenston. (Hlgh^ Level 
Comprehension) ^ 



The student will klentify those %vords spelled correctly 
in written communication. (Spelling) 



Lartguage MechanlS^ 

Objective 9 The student will Identify the correct use of a capital 
letter. (Capitalisation) 

Objective 10 The student will Identify the correct use of pdnctuation 
marks. (Punctuation) 

Objective 1 1 The student wilt identify correct capitalization and punc- 
tuation in a passage, friendly letter, or business letter. 
(Editing Skills) , 



46 7 
9 11 

467 
9 11 



467 
9 11 



467 
9 11 



467 
9 11 



48 7 
9 11 



467 

an 

467 
9 11 



467 
9 11 

46 7 
9 11 



'67 
9 11 

6 7 
9 

67 
9 11 



Objective 12 The student will Mentify the correct fonn of a tyord to 
complete a sentence. (Usage) 

CXijective 13 The student will kientify the subject or verb of a sen- 
tence Of will identify a sentenc« as being complete, 
incomplete, ^ run-on. (Sent«ice Oev^oiMnent) 

'f ^ 

Objective l^^^tm student wIM dentonstraie knowlec^ of ttie skills 
rrecessary to devek>p paracpli^ihs, (Paragraph 
Development) y 



Mathematics 

Objective 15 



Objective 16 
Obje<*live 17 



Objective 18 
Objectivs 19 

pbjeclive 20 
Objective 21 



The stiKient will add uaing whole numbmik fractions, 
decimals, Integers, algetx'alc eii;pressk>ns, or exponents. 
(Addition) ^ 

The student will subtract using whole ncfhibers, frac- 
tions, decimals. Integers, alget>ralc expresskins, of 
exponents. (Subtraction) r 

TThT student wUf muftlply using wtiole numbers, frac- 
?ns, ctodmals, Integers, exponertta,'t>srcmts, or 
^ ixpresskwfs. (Mutt^)»cition) 

The j^ident)will divide uskig whole nuinbers, fractk^s, 
declmaSrmtegers, or percents, (CHvlskKi) 

The student will den)onstrate an understanding of 
numeration, number sentences, and number theory. 
(Number Awareness) 

The sMIilent will demonstrate an understanding of 
problem solving, (Problem Solving) ^ 

The student will demonstrate an understanding of 
measurement and geometry. (Measurement/Geometry) 



i ocatkmet fifcUla 

Ob^tlve 22 



The student will locate informatkx) in books. (Book 
Parts) 



Objecth^ 23 The st4K$ent wlU locate infcnmation in the dkrtloni^. 
(Olctk>nary Skills) 

Objective 24 The stu(^t will k>cate Information in the iibra^y. 
(Library Skills) 

Objective 25 The stuctont will locate Information in eonsumer 
sources. (Consunryer Skills) 
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APPENDIX B 

* 

Test DevdopBM»it 

The Office of Dependents Schools (ODS) curriculum specialists for reading, language aif^ and 
mathematics provide guidan<^ and direction to CTB/McGraw-HiH content specialists in the selec- 
tion o^ items to match the priority objective. In total, 25 category objective were derived and 
partitioned into the subtest areas: word attack, vocabulary, reading com{H-efaeii|W>n, spelling, 
language mechanics, language expression, math computation, math conceit aM application, and 
locational skills. Each ^de level tested 19^21 of these objectives. A minimum Of four items were 
selected for each category objective. A complete description of the DoDDS cat^ory objectives is 
shown in Figure 2. - *• • ' . 

Utilizing the CTB/Mco/aw-Hill item pool, from which Form V of the Comprehensive Tests of • 
Basic Skills (CTBS U/V) also was developed, a soies of tests wer&«<nistructed in the subj^ areas 
and the grade levels specified by ODS. The overriding consicteration in the development of these 
assessment instruments was insuring the compatibility of the t^t items with the curricular objec- 
tives. The selection of itons was based cm two criteria: extent and ^atistics. From a conteitt point of 
view^ tl^ items must — ^ . 

a. Sati|(y the c^jectives. 

b. Have an {Kxe(^le vocabulary and readability level. . * 

c. Be q^rqmate for the targ^ group. 

From a statistical perspective. The items must — ' 



a. Be of appropriate difficulty leveL * \^ 

b. Not be biased i^;aiiist miocmty grouf^. 

c. Highly dtscriminate between ability tevels. ^ ^ - ■ ■ 
' d. Fit Ihe item response theory model. 

e. Have a low gumiug factor. . 

All items received rigorous review and analyse by DoDDS curriculum coordinators and outside 
panels of experts. 

When CTB was satisfied ^tha^K^ood test had been chosen, a field test edition was assemble and 
,review«l by DoDDS curriculum staff )n Washington the first w»k of May. 

VALIDATION OF TEST INSTRUMENTS 

Field Triid 

A field trial of the STP tests was conducted by CTB under ODS direction. The purpose of the 
field trial was to ensure that the tests would function properly. Specifically, the trial provided a 
means of judging the adequacy, accuracy, and appropriateness of (a) the t^ directions and 
manuals, (b) t\» practice test, (c) the test bookleu induding the sample items and the directions, 
(d) the time limits, (e) the difficulty levd of each test as a whok, and (0 scoring keys. The 
study found the tests to be soundly constructed and of high psychom^Ule quality. Comments of 
the teachers who participated in the fiekl trial were strongly su{n>ortive of the quality of tests and 
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the adequacy of the directions and manuals. Details regarding the field trial are provided in the 
**STP Field Test Report, July 1983". ^ " 

Extcrnid Reviews . . ' 

The tests were reviewed externally by a curriculum panel and a technical advisory committee. Con- 
current with the field trial, an independent review of the tests conducted by three specialists 
from the Washington. D.t., public schools' Competency-Based Curriculum staff. They were: 

.. ' : ' * • ' 

1. Dr. Helal Turner - Reading . ' 

2. Dr. Mary White - Language Arts 

3. Dr. Gordon LeiHs - Mathematics 4 

The individual reviews of these panelists showed that the tests appropriately reflected the cumcular 
areas. '■' 

» t 

In October 1982, a meeting of the Technical Advisory Conmihtee was convened for the purpo$c»of 
reviewing all of the technical supporting material documenting the comparability of Mic DoDDS 
STP to a national norm. The committec favorably endorsed the technical procedures and the qual-/ 
ity of the test. The Technical Advisory Committee members included: * 

1. Dr. Robert Linn, Chairperson, I>epartment of Educational Psychology, University of Illinois, 
Orbana (Measuronent and Evaluation). , . 

2. Dr. Jason MiUm^.iPtofessor, School of Education, Department of Psychology, Cornell 
^ University (Measurement and Evaluation). 

3. Dr. Richard Jaeger, Professor, JSchool of Education, University of North Carolina. 
Greensboro (Statistics). « 

4. Dr. Carol Tittle. Research Psychologist, University of North Carolina'. Greensboro (Research 
in Tests and Measurement). 

5. * Dr. Gary Bitter, Professor of Education, Arizona Stgte University, Tempc (Mathematics and 

Computer Education). < 

6. pr. Mf. Trika Smith-Burke, Associate Professor, Department of Educational Psychology, New 
York yniversity (Reading Education). ^ 
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